Opti-speech: a real-time, 3d visual feedback system for speech training
نویسندگان
چکیده
We describe an interactive 3D system to provide talkers with real-time information concerning their tongue and jaw movements during speech. Speech movement is tracked by a magnetometer system (Wave; NDI, Waterloo, Ontario, Canada). A customized interface allows users to view their current tongue position (represented as an avatar consisting of flesh-point markers and a modeled surface) placed in a synchronously moving, transparent head. Subjects receive augmented visual feedback when tongue sensors achieve the correct place of articulation. Preliminary data obtained for a group of adult talkers suggest this system can be used to reliably provide real-time feedback for American English consonant place of articulation targets. Future studies, including tests with communication disordered subjects, are described.
منابع مشابه
Visual Feedback of Tongue Movement for Novel Speech Sound Learning
Pronunciation training studies have yielded important information concerning the processing of audiovisual (AV) information. Second language (L2) learners show increased reliance on bottom-up, multimodal input for speech perception (compared to monolingual individuals). However, little is known about the role of viewing one's own speech articulation processes during speech training. The current...
متن کاملVowel classification for computer-based visual feedback for speech training for the hearing impaired
A visual speech training aid for persons with hearing impairments has been developed using a Windows-based multimedia computer. The training aid provides real time visual feedback as to the quality of pronunciation for 10 steady-state American English monopthong vowels (/aa/, /iy/, /uw/, /ae/, /er/, /ih/, /eh/, /ao/, /ah/, and /uh/). This training aid is thus referred to as a Vowel Articulation...
متن کاملVisual Feedback of Acoustic Voice Features in Voice Training
Speech technology has long been utilised to within computer-assisted tools for voice training. Such tools, providing real-time visual feedback of specific characteristics of the voice, complement traditional training methods. However, in order for such technology to be successful, specific aspects of voice training must be considered including the nature of voice perception, motor learning proc...
متن کاملSpeech Feature Computations for Visual Speech Articulation Training
SPEECH FEATURE COMPUTATIONS FOR VISUAL SPEECH ARTICULATION TRAINING Stefan Auberg Old Dominion University, 1996 Director: Dr. Stephen A. Zahorian A new version of the Visual Speech Articulation Training Aid was implemented which provides real-time visual feedback for speech articulation training. This version was migrated to a Windows Multimedia PC from a previous version which used a Personal ...
متن کاملToward a speaker-independent visual articulatory feedback system
Context Several studies tend to show that visual articulatory feedback is useful for phonetic correction, both for speech therapy and “Computer Aided Pronunciation Training” (CAPT) [1]. In [2], we proposed a visual articulatory feedback system based on a 3D talking head used in “an augmented speech scenario”, i.e. displaying all speech articulators including the tongue and velum. In the propose...
متن کامل